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Abstract In discussions at the 2015 HICSS meet¬ 
ing, it was argued that loads can provide most of 
the ancillary services required today and in the fu¬ 
ture. Through load-level and grid-level control de¬ 
sign, high-quality ancillary service for the grid is 
obtained without impacting quality of service deliv¬ 
ered to the consumer. This approach to grid regu¬ 
lation is called demand dispatch: loads are provid¬ 
ing service continuously and automatically, without 
consumer interference. 

In this paper we ask, what intelligence is re¬ 
quired at the grid-levell In particular, does the 
grid-operator require more than one-way communi¬ 
cation to the loads? Our main conclusion: risk is not 
great in lower frequency ranges, e.g., PJM’s RegA 
or BPA’s balancing reserves. In particular, ancillary 
services from refrigerators and pool-pumps can be 
obtained successfully with only one-way communi¬ 
cation. This requires intelligence at the loads, and 
much less intelligence at the grid level. 
Acknowledgements Research supported by the 
NSF grant CPS-1259040, and the French National 
Research Agency grant ANR-12-MONU-0019. 

1 Introduction 

Recent FERC rules require that ISO/RTOs provide 
incentives to responsive resources to help balance 
supply and demand in the power grid. EERC Or¬ 
der 755 directs RTOs and ISOs to provide a “pay¬ 
ment for performance that reflects the quantity of 
frequency regulation service provided by a resource 
when the resource is accurately following the dis¬ 
patch signal”. Preliminary studies suggest that these 
incentives are having desirable impact. In this pa¬ 
per, we investigate the value of performance. 

One year after adoption of new performance in¬ 
centives at MISO, the availability of fast ancillary 


services increased significantly in the real-time mar¬ 
ket. The report [3] on which Pig. 1 is based also 
demonstrates improved control performance since 
the adoption of these incentives. 

New market rules for regulation services adopted 
at PJM were also successful. It was found that their 
overall costs were reduced, even with the higher 
payments to ancillary service providers [23]. 

Pages 23 and 24 of the FERC 755 report [19] 
contain a survey of experiments conducted by Bea¬ 
con Power and Primus Power on the value of highly 
responsive resources for ancillary service. Primus 
claims that this results in approximately 76 percent 
more ACE correction (compared with what can be 
obtained from generation sources). This is because 
a “slower ramping resource lags to the point of 
working against needed ACE correction”. 

These empirical results show that high- 
performance may add value. On the other 
hand, the grid has been remarkably reliable despite 
poor performance from traditional sources of an¬ 
cillary service. Kirby in [12] shows that regulation 
obtained from coal generators is in some cases 
excellent, and in other cases the generators show 
significant delay in response. There is no evidence 
that poor tracking performance led to grid outages, 
but it is likely that there are hidden costs. 



Figure 1: Average total daily regulation volume at MISO: Availability 
of fast-ramping resources expanded after MISO introduced payment 
for performance. 

One goal of the research surveyed in this paper is 
to explain why the grid is so resilient to the distur- 
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bances introduced to the grid through the poor reg¬ 
ulation performance described by Kirby, and why it 
is nevertheless sensible to incentivize high perfor¬ 
mance for certain types of regulation services. 

The ultimate goal of this research is to cre¬ 
ate needed ancillary services through “intelligent 
loads”. In prior research surveyed at the 2015 
HICSS meeting, it was argued that loads can pro¬ 
vide most of the ancillary services required today 
and in the future [2]. To ensure reliability to grid 
operators and to consumers, ancillary services from 
loads should be provided continuously and auto¬ 
matically, without consumer interference. This ap¬ 
proach is henceforth called demand dispatch [5]. 

A key element in prior work is a frequency de¬ 
composition of the regulation signal, and a classifi¬ 
cation of loads based on the bandwidth of ancillary 
service they can provide [2, 11,14, 17]. Provided in¬ 
telligence at each load is designed so that these and 
other constraints are recognized, high-quality ancil¬ 
lary service for the grid is obtained without impact¬ 
ing quality of service delivered to the consumer. 



Figure 2: Decomposition of residual generation Ur into three products, 
differentiated by frequency content, to serve a 4 GW load at BPA. 

To illustrate the application of these concepts, 
consider the Bonneville Power Authority (BPA) re¬ 
gion in the Northwestern United States during the 
first week of January, 2015 [1]. As an exercise, sup¬ 
pose that a constant 4 GW load must be served, in 
spite of volatile power from wind. The power that is 
not provided by wind generation is denoted by Ur{t) 
in Fig. 2. Observe that Ur{t) « 4 on New Years 
Day since there was little power from wind on that 
day. At other times, power from wind generation is 
nearly 4 GW, so that Ur(f) ~ 0. 

The signal Uip is obtained by passing Ur through 


a non-causal low-pass filter. The justification is that 
the day-ahead forecast of the low-frequency compo¬ 
nent of the wind is very accurate. Uhp is obtained by 
passing Ur — Uip through a causal high-pass filter, 
and Ump is the remainder of needed power. 

The time-scale of Uhp is similar to the valuable 
RegD signal used at PJM [21]. In research con¬ 
ducted at the University of Florida, it is shown that 
loads in commercial HVAC systems can provide 
this ancillary service with negligible cost, and no 
impact on building climate [11,14]. The time-scale 
of Ump corresponds to what can be provided from 
thermostatically controlled loads (TCLs), as consid¬ 
ered in [16], residential pool pumps [2] (a load of 
approximately IGW in Florida or California), and 
many other loads. 

The low frequency deviation Uip can be obtained 
from generation sources such as thermal or hydro. 
Some or all of this can be obtained from ramping up 
and down power consumption in aluminum manu¬ 
facturing or other large commercial loads. 

In this paper we ask, what intelligence is required 
at the grid-level to implement demand dispatch"? In 
particular, does the grid-operator require more than 
one-way communication to the loads? The ques¬ 
tion is investigated using two separate lenses. The 
first is in terms of system-wide risk: does poor per¬ 
formance threaten grid stability? The second set 
of questions are framed in terms of system-wide 
cost. In particular, if 50% of resources provide 
poor-quality ancillary service, what is the impact on 
the other 50%? 

The analysis is based on a standard input-output 
model of the grid [13], denoted Gp in Fig. 3. The 
“desired behavior” will be zero, and Y(t) will rep¬ 
resent a deviation whose desired value is zero. The 
actuation block in the figure is obtained using de¬ 
mand dispatch along with conventional sources of 
ancillary service. 

Using arguments from classical control, it is ar¬ 
gued that it makes sense to pay a premium for accu¬ 
rate regulating reserves in higher frequency bands, 
while the value of performance is not so great in 
lower frequency bands: 

(i) The highest bandwidth of ancillary service 
considered in this paper is on time-scales cor¬ 
responding to primary reserves. This is the re- 
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Figure 3: Power Grid Control Loop. A question addressed in this paper: where do we find H? 


gion of highest risk, which is not surprising to 
grid operators who are conservative in setting 
droop parameters for governors. 

(ii) Risk is not great in lower frequency ranges; 
time-scales ranging from several minutes to 
hours. 

At these lower frequency ranges, there is lit¬ 
tle cost for poor performance, but there may 
be high cost for heterogeneity. In particular, 
if 50% of resources provide poor quality an¬ 
cillary service in terms of phase lag, then the 
other 50% may be forced to provide greater 
service to the grid. 

It is argued that the impact of heterogeneity 
can be reduced through an additional layer of 
local control at each load. 

The good news: two-way communication may not 
be required. If intelligence at the loads is designed 
appropriately, then the grid will obtain the required 
regulation with only one-way communication from 
balancing authority to these intelligent loads. 

The greatest benefit of demand dispatch is for 
slower time-scales such as the balancing reserves at 
BPA [1], or PJM’s RegA signal [21]. We can obtain 
all of these sources of ancillary service from flexible 
loads with no risk to the grid, and no loss of service 
to consumers. 

Of course, even if there is no cost, the consumer 
needs incentives to participate. We envision en¬ 
gagement through contracts, much like the Florida 
OnCall program. It is likely that there will be a fixed 
payment for engagement, and regular payments that 
are proportional to “services rendered” (much like 
the mileage payments in place today, in response to 
FERC order 755 [23]). 


ied, and have received attention recently due to con¬ 
cerns about grid inertia. The recent work [7] studies 
the impact of new trends, such as the deployment 
of inverter interfaced generation on the dynamics of 
the grid. 

The paper [20], following [8], shows the diverse 
effects that fast resources can have on system stabil¬ 
ity. These grid models are used in our investigations 
here. 

Dynamic models of major household appliances 
and their DR potential is investigated in [15, 16] (see 
also the references therein). 

Controlling loads using a randomized policy was 
studied in several works, such as [16,17]. The mas¬ 
ters thesis [4] proposes randomization to solve the 
synchronization problem that arises in application 
of Schweppe’s TAPER algorithm for distributed fre¬ 
quency control [22]. 

The remainder of this paper contains three ad¬ 
ditional sections, organized as follows: Section 2 
contains the details of the three components of the 
block diagram shown in Eig. 3. The grid model Gp 
and compensator Gc are based on standard and re¬ 
cent sources. Greater attention is devoted to the ac¬ 
tuator block, which includes grid-level models for 
a combination of several classes of loads involved 
in demand dispatch. In Section 3, control concepts 
are applied to a specific scenario involving just two 
classes of loads working in conjunction with tradi¬ 
tional ancillary service resources. Simulations illus¬ 
trate the main conclusions. Conclusions and direc¬ 
tions for future research are contained in Section 4. 

2 A Distributed Control Problem 

The realization of the three power products shown 
in Eig. 2 can be obtained using a hierarchical control 
strategy. At the grid level, the low frequency signal 
UIp could be obtained from a day-ahead market or 


Related research Models that can capture the dy¬ 
namics of the entire grid have been extensively stud¬ 
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contracts with generators and commercial loads. 

The higher frequency components of U can be 
obtained using demand dispatch. The ‘intelligence’ 
at each load involves local control at each device 
to achieve two goals: reliable service to the grid, 
and high quality of service to the customer that the 
device serves. The main goal of this paper is to un¬ 
derstand the level of reliability required. 

We begin with a model of the grid. 

2.1 Grid dynamics 

A transfer function model of the grid is denoted Gp 
in Fig. 3. We assume here that the input to Gp is 
power deviation, and the output is the deviation of 
grid frequency from its nominal value (60 Hz in the 
U.S.). In practice, we would also measure tie-line 
error and other grid disturbances. 

An approximate grid model can be obtained by 
considering an interconnection of aggregate gener¬ 
ation and governor dynamics, as in [8] and other 
papers. The final model is justified by observing the 
dynamics of the grid following a fault; the initial 
trajectory can be interpreted as the transient portion 
of a step response. 



Figure 4: Frequency deviations following a generation outage - exam¬ 
ples from WECC and ERCOT. 


Fig. 4 shows examples from WECC (Western 
US; taken from Fig. 57 of [18]) and ERCOT (Texas) 
[20]. The slow recovery of grid frequency to its 
nominal value in the WECC plots is due to sec¬ 
ondary control. This is not a part of Gp since we 
do not consider contingency reserves in this paper. 

In theoretical models of the grid, the transfer 
function depends on the nominal load. This is 
consistent with observations of the grid following 
a fault [8, 13]. Consequently, there is significant 


model uncertainty and variability that must be re¬ 
spected in control design at the grid level. 

One version of the ERCOT model is used in the 
simulation studies summarized in Section 3: the 
grid model of [8] was used in which the net load 
(load minus wind generation) is 25 GW, resulting in 


0.6445-f 0.147 
“ 52 -h0.47975-h0.147 


( 1 ) 


Corresponding grid frequency dynamics are shown 
in Example 1 of Eig. 4. This transfer function has 
natural frequency G)„ =0.3834, and damping ratio 
^ = 0.6256. The large frequency excursion seen in 
Eig. 4 is due to the zero in Gp. 


2.2 Actuator dynamics 

The transfer function H will be the sum of sev¬ 
eral transfer functions whose dynamics are shaped 
by the dynamics of the resource providing ancillary 
service and some pre-filtering — both locally and at 
the grid-level. Consider the case of PJM in which 
Ha and Hy can be associated with RegD and RegA, 
respectively. Because accurate tracking is required 
for RegD, the transfer function Ha is shaped entirely 
at PJM, and the signal t/*(t) will accurately track a 
multiple of the RegD signal. The transfer function 
Hh will include a model of the dynamics of the re¬ 
sources providing the service. 

Based on industry practice, and to simplify con¬ 
trol design, the following convention is imposed on 
the feedback architecture: the signal U in Pig. 3 
is scalar valued. Subsequently, it may be decom¬ 
posed into the sum of several signals differentiated 
by bandwidth, but these dynamics are modeled in 
H. 

In our prior work using two-way communication 
combined with local control, the loads could track 
the desired regulation signal nearly perfectly. With¬ 
out two-way communication, the loads will intro¬ 
duce both dynamics and uncertainty in the transfer 
function H. 

We are, however, free to introduce additional lo¬ 
cal control to improve grid-level performance. Sec¬ 
tion 3 contains examples in which load dynamics 
exhibit resonance and some phase-lag. Eet G/ de¬ 
note a transfer function that models the dynamics 
for a particular class of loads. These dynamics are 
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Figure 5: RegA and RegD at PJM for two hours in May, 2014. 


easily identified, so additional filtering at the load 
is used to improve the input-output behavior. The 
dynamics of the filtered loads are expressed 

H,{s)=M,is)Gi{s) (2) 

The pre-filter Mi is designed so that the collection 
of loads has reduced resonance, improved phase re¬ 
sponse, and greater bandwidth. 

This design step has not appeared in prior work. 
The overall design is illustrated through examples 
in Section 3. 

2.3 Grid disturbance 

Before turning to the design of the compensator Gc, 
we first consider how PJM defines the signal U ap¬ 
pearing in Fig. 3. It is obtained by first construct¬ 
ing the area control error (ACE), which is a linear 
combination of grid frequency deviation and tie-line 
error. The ACE signal is passed through a PI com¬ 
pensator (their Gc) [21], and this is then transformed 
into a sum of two signals, RegA and RegD. Pig. 5 
compares the two signals over a two hour time pe¬ 
riod. The higher frequency content in RegD is evi¬ 
dent from the figure. 


Estimated PSD at PJM: May 1,2014 -RegA -RegD 



Figure 6: PSD for the RegA and RegD at PJM based on 24 hours of 
data. 


Power spectral density (PSD) estimates were ob¬ 
tained using time series over a 24 hour period on 
the same day. A comparison of the plots shown in 
Pig. 6 shows again the higher frequency content in 
RegD. It also shows very little energy in frequencies 
greater than 10^^ rad/s. 

It follows that a compensator Gc at PJM will re¬ 
quire high gain for frequencies as high as about 
10 ^^, and relatively low gain at frequencies above 
ft) = 10^^ rad/s. 

The balancing reserves at BPA have significantly 
greater low frequency content. At ISO/RTOs, this 
low frequency regulation is obtained in the real-time 
market. 

2.4 Control design 

The loop transfer function associated with the feed¬ 
back loop in Pig. 3 is the product of the three 
transfer functions: L{s) = Gc{s)H{s)Gp{s). The 
crossover frequency is by definition the value for 
which \L{jo)c)\ = 1. This frequency is unique by 
design, and chosen by the grid operator through 
the choice of parameters in the compensator Gc- 
The grid transfer function Gp is approximated by 
a second-order transfer function, whose natural fre¬ 
quency ft),, depends on load. Because of this un¬ 
certainty, the compensator should suppress the gain 
of the loop transfer function in this range of uncer¬ 
tainty {(On ranges from 0.2 to 1 rad/s in the ERCOT 
model). 

Pollowing standard design for power systems and 
elsewhere, we adopt the PI compensator, 

Gc{s)=k'^ (3) 

In the simulations described later in the paper, we 
take j8 =0.5 and fix the gain K so that cOc = 
0.05 rad/s; the crossover frequency (Oc is known to 
approximate the closed loop bandwidth. With this 
design we hope to achieve two goals: disturbance 
rejection in the frequency range where disturbances 
are present, and robustness to uncertainty in grid dy¬ 
namics. 

2.5 Cost of heterogeneity 

Suppose that we have two sources of ancillary ser¬ 
vice: the first provides perfectly accurate service. 
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but is costly. The second is free, but inaccurate. 
Our control solutions are insensitive to un-modeled 
dynamics, especially at low frequency. We may 
ask, does the introduction of the poor-quality ser¬ 
vice create a cost, because the more expensive ser¬ 
vices must work harder? 

To address this question we introduce two trans¬ 
fer functions Ga and Gb, modeling accurate and in¬ 
accurate resources, and for p G [0,1] denote 

H = Ha+Hb = {l-p)Ga + pGb (4) 

In this subsection we are concerned with the magni¬ 
tude of service delivered by the accurate actuators, 
denoted U^{t) in Fig. 3; in transfer function nota¬ 
tion, U^/U = (1 — p)Ga- The steady-state analysis 
is based on the following representation: 


Lemma 2.1 The transfer functions from the distur¬ 
bance to output, and from disturbance to are 
given by, respectively. 


Y 

D 

^ a 

D 


Gp 

1+L 


-(1-p) 


1+L 


( 5 ) 

( 6 ) 


in which L = GcHGp is the loop transfer function, 
and L^ — p- 


Proof The first identity is obtained using stan¬ 
dard arguments: from the figure we obfain Y = 
Gp{D — GcHY), since “desired behavior” is zero by 
definifion. Solving fhis algebraic equafion gives (5). 

The following Iransfer funcfion is easily idenfi- 
fied from fhe figure and fhe definifion of U^{t): 

^ = -{\-p)GaGc (7) 



Figure 7: System cost at a single frequency: the highest cost is expected 
with a mix of approximately 50% of the two sources of ancillary ser¬ 
vice. 


Normalize fhe Iransfer functions so fhaf 
\GaU^))\ = \GbU^)\ = 1- The firsl resource is 
assumed fo be perfecl, Ga{s) = 1, and we denote 
= ^GbijtOo). 

Fig. 7 shows fhe cosf Icq as a function of p for a 
range of values of 0e, and a fixed value of coq. When 
fhere is no heterogeneity (0 b = 0), fhe cosf decays 
linearly. For 0 b > 90 degrees, fhe cosf is maximized 
near p = 1/2. 

The common slope af p = 1 can be idenfified as. 


d 

dp 


Lo(p,teo) 



La (/ (Oq ) 

P =1 

1 -i-L(JCOo) 


In conclusion: a free resource may be cosily if 
if does nof accurafely follow fhe regulation signal. 
However, fhe common slope af p = 1 means fhaf 
cheap resources are valuable, provided fhey arenT 
mixed wifh ofhers. 

All of fhese conclusions presume fhaf fhe syslem 
is slable. In fhe nexf secfion we consider bofh sfa- 
bilify and cosf in a more realistic model. 


3 Risk & Cost using Demand Dispatch 


The Iransfer funcfion (6) is oblained on combining 

(5) and (7). □ 

Consider a sfeady-slafe selling in which fhe dis- 
lurbance D, shown in Fig. 3, is purely periodic: 
D{t) = sin(ft)ot) for some (Oo> 0, and all olher sig¬ 
nals are periodic wifh fhe same frequency. Applying 

(6) , we musf have U^{t) = kosm{(Oot + 0o), where 
^0 = \U^/D{j(OQ)\ and 0o = ZU^/D{j(Oo). The gain 
ko = ko(p,ft)o) is interpreted as fhe cosf; fhis is mo- 
fivaled by currenl mileage paymenfs af ISOs [23]. 


Experimenls were conducled using demand dis- 
palch, wifh one-way communication from grid fo 
loads. 

The grid Iransfer funcfion Gp in Fig. 3 was laken 
fo be fhe second-order linear system (1), whose nal- 
ural frequency is G)„ = 0.3834. As discussed in 
fhe Section 2.1, fhe grid iransfer funcfion is sensi- 
live fo load and generalion mix. This uncertainly 
means fhaf we should mainlain a closed loop band- 
widlh significanfly below fhe nalural frequency of 
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(a) Lead design with 0)co — 0.007 rad/s. 


(b) Inverse design, with cOco — 0.013 rad/s. 


Figure 8: Comparison of disturbance rejection performance obtained with two different pre-filter designs. 


the grid. The PI compensator (3) is designed to set 
the crossover frequency to (Oc = 0.05 rad/s. 

The disturbance D was defined as the balancing 
reserves deployed at BPA during a typical week: 
June 6, 2015 to June 12, 2015 (data available at [1]). 
Fig. 8 shows a plot of D during the first day of this 
week, along with the closed loop response Y ob¬ 
tained using two different designs. The poor perfor¬ 
mance seen in Fig. 8a is eliminated with better local 
control at the loads. These results are explained in 
Section 3.5. 

The actuator transfer function N is described 
next. 

3.1 Actuator block 

The actuator block H in Fig. 3 is obtained from 
a combination of three resources: a transfer func¬ 
tion Ga representing an expensive, high-quality re¬ 
source, and two actuators Hpi and Htd, which are 
based on two separate collection of loads. The 
two classes of loads work in parallel: the ‘pools’ 
could represent a large collection of residential pool 
loads, or other loads that provide flexibility in a 
low frequency range. The ‘TCLs’ represent flexi¬ 
ble loads providing ancillary service in a higher fre¬ 
quency range; these may include refrigerators, wa¬ 
ter heaters, and air-conditioners. 

Just as in Section 2.5, the performance of Ga is 
assumed to be perfect, with = 1. 

In addition, we introduce a parameter p, a low 
pass filter Hi^p, a high pass filter Hhp, and define 
the overall actuator transfer function as follows: 

H=HLPm + {\-HLp)Ga 

(o) 

where Hi = Hp, +Hhp[{ 1 - p)Ga + pH,ai] 


This design choice is based on several considera¬ 
tions: 

(i) The low pass filter Hpp is introduced because 
of risk of instability due to gain or phase un¬ 
certainty from load response: it is designed so 
that the response from loads is not significant 
near the crossover frequency (Oc- 

(ii) The high-pass filter Hhp is used to limit the 
low-frequency content of the regulation signal 
sent to the TCLs. This is to help guarantee QoS 
(quality of service) constraints for these loads. 

(iii) The purpose of the parameter p is to inves¬ 
tigate cost as a function of the proportion of 
TCLs engaged. It will be seen that their imper¬ 
fect response may introduce cost to the system. 

For Hpp, we used a second-order Butterworth low 
pass filter with cut-off frequency (Oco and damping 
ratio Qp = 'Jljl, with transfer function Hlp{s) = 
co^o /+ '^^ip^coS + Wco)- The cut-off frequency 
(Oco is a parameter used in our cost/risk evaluations. 

Various values for the cut-off frequency were 
considered, but the upper bound (Oco < 0.013 rad/s 
was imposed throughout. This is not because the 
loads cannot provide service at higher frequen¬ 
cies, but because the response from uncertain loads 
should be attenuated near the crossover frequency 
(Oc = 0.05 rad/s. 

For the high-pass filter Hhp, a second-order But¬ 
terworth filter was used, with cut-off frequency 
of 0.0004 rad/s: Hhp{s) = /{s^ + 0.0005657^ -|- 

1.6 X 10^^). This was chosen based on the band¬ 
width constraints for pools, and QoS constraints for 
TCLs. 
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Further details are provided in the next subsec¬ 
tion. 

In the numerical experiments reported here, we 
have simulated the linear mean-field model of [17], 
and not the collection of loads. In all prior work it 
is found that the mean-field deterministic model re¬ 
flects actual behavior very accurately, especially in 
a control setting. This is true even when only 100 
loads are engaged [10]. A more detailed simulation 
taking into account transmission and perhaps distri¬ 
bution will be the subject of future work. 

3.2 Load models and pre-filter design 

The transfer function H in Fig. 3 is obtained from 
a combination of resources, including demand dis¬ 
patch. In prior work it has been shown that a ran¬ 
domized control architecture for each load leads 
to a tractable input-output model for the aggregate 
mean-field model [2]. If is nonlinear, buf a lin¬ 
earized model worked well for purposes of estima¬ 
tion, confrol and performance evaluafion [9, 10]. In 
fhe case of residential pools pumps, fhe focus of 
fhese fhree papers, fhe fransfer funcfion for fhe lin¬ 
ear model has a sfrong resonance af a frequency cor¬ 
responding fo a period of 24 hours. The fransfer 
funcfion depends on fhe number of hours of clean¬ 
ing per day, buf the resonance is independent of 
this parameter. A second-order approximation was 
adopted, 

s^-\-2 C,pi copis -\- (oji ’ 

with natural frequency (Opi = 1.21 x 10^^ rad/s; this 
corresponds to the 24-hour periodic behavior of 
pools. 

The behavior of a typical TCL is similar to a pool 
filtration system. Take, for example, a typical resi¬ 
dential refrigerator. Its nominal behavior is similar 
to a pool pump, with two exceptions. First, the be¬ 
havior is roughly periodic with period much shorter 
than 24 hours. Second, in many cases the operating 
time is a smaller fraction of this period. We have ob¬ 
tained an input-output model using a technique sim¬ 
ilar to what is introduced in [2], and find thaf a col¬ 
lection of residenfial refrigerators wifh a 30 minute 
cycle-time admits a linear system model with res¬ 
onance corresponding to this period. Accordingly, 


a second-order approximation for the aggregate of 
TCLs was used in these experiments, 

Gtcl = 2 , , 2 ’ ( 10 ) 

s^ -\-2Qci(>itci^ + (^tci 

with natural frequency (Otd = 0.003 rad/s, which 
approximately corresponds to the 30-minute cycle¬ 
time. 

The damping ratios were set to i^pi = Qd = 0-5- 
Other values were tested with similar results. 

To obtain the two transfer functions Hpi and Htd 
appearing in (8) requires one additional ingredient. 

In prior work, it is shown that the bandwidth 
of ancillary service provided by loads can be ex¬ 
tended through feedback. Even though the natural 
frequency for the linear model of [17] corresponds 
to 24 hours, a grid-level control solution extends 
the closed loop bandwidth by one decade, resulting 
in a closed-loop natural frequency of approximately 
7.27 X 10^^ rad/s, and without resonance. 

In the experiments described here, we do not al¬ 
low communication from load to grid, so we cannot 
extend bandwidth using the approach of [17]. In¬ 
stead, the bandwidth is set through the design of the 
pre-filter introduced in Section 2.2. 

The local filters used at the pools and the TCLs 
are denoted Mpi and Mtd, respectively. Following 
(2), we obtain the two actuator transfer functions, 

Hpi=Mp,Gp, H,d=MrdG,d (H) 

The overall actuator transfer function of (8) is writ¬ 
ten, 

H = Ha+Hb-. = PaGa+HLpHB ( 12 ) 

in which Hb = [Hpi + pHupHtd] and 

Pa = l-HLp[\-HHp{l-p)] (13) 

When p = 1, the transfer function // is a convex 
combination of good and potentially “bad” actua¬ 
tors: 

H={l-HLp)Ga+HLpHB 

Two designs were considered for the local fil¬ 
ter. 


(i) Lead design: For T > 0 and a <\, 



T5-|- 1 
aT5-|-1 


2 


( 14 ) 






Figure 9: Hg obtained using the lead design. 


(ii) Inverse design: For a <1, 

Mi = {a + G,)-^ (15) 

The inverse design is intended to approximate the 
inverse of the transfer function for the aggregate 
load model. In very recent work, we have found that 
a better approximation can be obtained using con¬ 
cepts from robust control theory — this topic will 
be explored in detail in future work. 

The lead design (14) consists of two lead 
compensators in series: this is to counter the 
—40 dB/decade slope after the resonance in the load 
transfer functions. The lead compensator is a high- 
pass filter, so the bandwidth of the loads is increased 
by some value depending on a and T. 

The lead design was applied to both pools and 
TCLs: we chose Tpi = 15,000 and Ztd = 350, so 
that is slightly smaller than the natural frequen¬ 
cies of the respective loads. In addition, we set 
oCpi = 1/15 and (Xtd = 1 /5. Using these settings for 
the lead design, we achieve the required bandwidth 
extension for pools and TCLs. 

The inverse design was also applied to both 
classes of loads. In the simulations that follow we 
only show results obtained when the inverse design 
was used to construct M,d ; it was found that sensi¬ 
tivity of performance to the choice of the pre-filter 
Mpi is not great. 

Fig. 9 shows a Bode plot of Hb using the lead 
design with p = 1. The rapid phase decline at 
high frequencies motivates the cut-off frequency at 
(Oco = 0.003 rad/s. We do not observe large phase 
lag using the inverse design for the TCLs, so we can 
take a larger value for (Oco in this case. 


We will look more closely at the impact of these 
design choices in the following. 

3.3 Transfer functions to model risk & perfor¬ 
mance 

Recall that the loop transfer function is L = GcHGp. 
The corresponding system sensitivity transfer func¬ 
tion is defined in confrol fexfs as 


and ifs maximum gain is denofed 

M 5 = ||S||„ = sup|S(jm)| (17) 

CO 



Figure 10: Sensitivity using the lead design. The closed-loop system is 
not sensitive to the imperfect response from TCLs when cOco — 0.005 
or smaller. 

The ferminology is mofivafed by fhe inferprefa- 
fion, 

\S{j(o)\ =d{L{j(o),-l) 

where d{L{jo)),—l) = \L{jo)) -|- 1|. The minimum 
miuco |L(jft)) -|- 11 is called fhe vector margin or fhe 
stability margin. If fhis is zero, fhen fhere is a closed 
loop pole on fhe imaginary axis, so fhe system is nol 
sfable. From fhe definitions, a small sfabilify margin 
is equivalenf fo a large maximal sensifivify Ms- 

Fig. 10 shows fhe magnifude plof of fhe sen- 
sifivify function (16) for various values of p and 
(Oco using fhe lead design. The maximal sensi- 
fivify grows quickly wifh cOco when p = 1. Wifh 
(Oco = 0.003 rad/s, we find fhaf fhe sensifivify plofs 
are similar for p = 0 or p = 1. 
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Sensitivity using the inverse design is lower for 
any cOco < 0.013 rad/s, and the value of p has little 
impact on sensitivity for this range of (Oco- 

Recall from (5) that the transfer function from 
disturbance to output isY/D = Gpj{ \ +L). Fig. 11 
shows Bode plots of this transfer function for the 
lead design: Using (Oco = 0.003 rad/s, the system ef¬ 
fectively suppresses disturbances whose frequency 
is below ft) = 10^^. Performance degrades when 
using larger values of cOco- For the inverse design, 
the transfer function F/D is largely independent of 
p for any (Oco < 0.013 rad/s. 



Frequency (rad/s) 


Figure 11: Disturbance rejection using the lead design. 


3.4 Mean-square cost 


Let U^{t) denote the signal supplied by the high- 
quality actuators. Based on the block diagram 
shown in Fig. 3 and the definition of H in (8), we 
have 


Ug _ n L, 

D “l+V 


(18) 


in which La = GcGaGp. The proof of (18) is similar 
to the derivation of (6). 

The maximal sensitivity is denoted 


Ma = 


^ a 

D 


= sup 
to 


[/* 

-tm 


(19) 


While (19) is a common performance metric in the 
control literature, the maximizing frequency may 
have little to do with the frequencies encountered 
in operation. 

The following L 2 cost is based on a statistical 
model of the disturbances entering the grid. We as¬ 
sume a steady-state setting in which the following 


mean-square system cost is well defined, and finife 
a.s., 

72= hml ( 20 ) 

r^oo 1 Jo 

This has a represenfafion via specfral fheory of sfa- 
fionary processes [6]. 

The power specfral density Pjj for D can be es- 
fimafed by filling observed dala lo a linear syslem 
driven by while noise [6]. As done previously in 
[9], Ihis approach was used lo obfain an esfimale 
of Pd for Ihe BPA balancing reserves. The resulting 
power specfral density for a slafionary version off/* 
is given by 


Pu^{(o) = Pd{(o) 



2 


where Ihe Iransfer function is defined in (18). The 
mean-square syslem cosl is expressed. 


1 


( 21 ) 


Fig. 12 shows Iwo plofs of 7 as a function of p 
for several values of (Oco- For comparison, in each 
plol, we include Ihe cosl plol for (Oco = 0.013 rad/s 
and an “ideal TCL” in which Gtci{s) = 1. 

In Ihe lead design, Ihe cosl is near ils minimum 
when p = 1 and cOco = 0.003 rad/s. In olher words, 
wilh Ibis lead design, we can minimize Ihe syslem 
cosl by including all Ihe available TCL resources 
provided Ihey service regulation signals wilh fre¬ 
quencies below 0.003 rad/s. 

The bandwidlh of TCL service can be increased 
significanlly wilh more aggressive local conlrol. 
For Ihe inverse design, Ihe cosl is al ils lowesl for 
(Oco = 0.013 rad/s. The performance nearly malches 
Ihe ideal performance in Ihis case. 


3.5 Disturbance rejection 

The disturbance-rejection performance of the sys¬ 
tem was evaluated using Simulink. Multiple exper¬ 
iments were conducted to evaluate performance us¬ 
ing several different designs. 

In each case, p was set to 1 in the definition of 
the actuator block H (see (8)). The remaining com¬ 
ponents of the block diagram shown in Fig. 3 are as 
specified in this section. 

In summary. 
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Figure 12: Cost 7 as a function of p and cOco for the two designs. The cost obtained using the inverse design is similar to what is obtained using an 
ideal actuator, Hfd = 1. 


(i) When lead control is absent, the closed loop 
system is unstable for cOco > 0.003 rad/s, which 
is the natural frequency of Gtd- 

(ii) For the lead design, disturbance rejection is 
very good for cOco < 0.005 rad/s; the system is 
unstable for (Oco > 0.009 rad/s. 

Fig. 8a shows results for cOco = 0.007 rad/s. 
The oscillation is due to a strong resonance 
in the closed loop system — this is caused by 
phase lag in Htd- 

(iii) Disturbance rejection is improved using the 
inverse design for the TCLs. Results obtained 
with (Oco = 0.013 rad/s are shown in Fig. 8b. 
The disturbance rejection observed here is the 
best among all experiments. 

4 Conclusions 

With appropriate filtering and local control. De¬ 
mand Dispatch can provide excellent ancillary ser¬ 
vice in low-to-mid frequency ranges, even without 
two-way communication. While there is some cost 
to install hardware on appliances that can receive a 
signal from a balancing authority, in the long run 
this will be far less expensive than batteries. 

The grid operator does require some bounds on 
the behavior of loads. In particular, gain uncer¬ 
tainty is a potential concern, especially in frequency 
ranges corresponding to PJM’s RegD signal and 
above. It may be valuable for each load to broad¬ 
cast its state occasionally - perhaps just once per 
hour - so that capacity can be estimated at the grid 
level [10]. 


The best communication architecture for higher 
frequencies (corresponding to primary reserves) re¬ 
mains a research frontier. 
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